Amendment under 37 C.F.R. §1.111 Attorney Docket No. Q67687 
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AMENDMENTS TO THE SPECIFICATION 

Please replace the present title with the following amended title: 

IMAGE RETRIEVAL METHOD 
BASED ON COMBINATION OF COLOR AND TEXTURE FEATURES 



Please replace the first full paragraph appearing on page 7 of the specification with 
the following amended paragraph: 

In step (a2), the texture distance between each color vector of each region of the query 
image and each color vector of each region of each data image may be calculated using: 
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where a(m^) is the standard deviation of the mean value for a color vector for a region of the 
i-th frequency channel and i-th orientation channel and where o(o\j) is the deviation of the 
standard deviation of the color vector for a region of i-th frequency channel and the j-th 
orientation channel. 



Please replace the second paragraph beginning on page 7 of the specification with 
the following amended paragraph: 

Preferably, step (pa-2) comprises: (pb-1) obtaining a grid map of the query image and 
each data image; and (pb-2) obtaining a texture sample of a desired size for each region based on 
the grid map. In this case, step (pb-1) may comprise: (pb-1-1) taking a rectangle M(iJ) having 



Amendment under 37 C.F.R. §1.111 Attorney Docket No. Q67687 

U.S. Application No. 10/040,621 

largest side lengths for a sample region, where 0 <i <n and 0 <j <m\ (pb-1-2) dividing the 
rectangle M(iJ) into sub-rectangles each having a Ix I size; and (pb-1-3) obtaining a grid map 
for the sample region using a predetermined function 



Jl if p ij (x,y)cI k for\/(x,y) 
M grid (iJ)= Q otherwise 



which outputs 1 if all the divided grids belong to the sample region, and otherwise, 
outputs 0, the predetermined function expressed by: 



where 0 < i < 



m 
7 



1 (where 



- 1 (where In/11 is a result of applying a floor function) , 0 < j < 

fm/11 is a result of applying a ceiling function) , 0<jc</-l,0<y</-l, and p u (x,y) is a point 
that belongs to rectangle M(il + x, jl + y). Preferably, after step (pb-1-3), the image retrieval 
method further comprises: (pb-1-4) transforming the grid map obtained in step (pb-1-3) to a grid 
distance map by repeating computations with: 

{ M U (». J) )o = M 8 ri<t (i. J) . ^ 
{<„,(/,;)}„ = min({M^(i, j- l)} n _ p {M^(/- 1, j)} n _ v {M^(iJ + 1)} w . p {M^(i+ 1,./)}^) + 1, 

if {*C(^U-i = {KAiJ)} n >M d grid (iJ) = {M d grid (iJ)) n , and 
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(pb-1-5) performing region growing in every direction from a seed of the grid map, which has 
the largest distance in the grid and is expressed by (a,b) = "J* ™ { Af^(ij)}, to satisfy the 

relation M d rid (iJ) > 0 until the maximum area rectangle is extracted. 



Please replace the first full paragraph appearing on page 11 of the specification with 
the following amended paragraph: 

In the image retrieval method, step (b-2) may comprise projecting the color and texture 
distances onto a 1 -dimensional distance space using: 



a d{I q J x )=W c d c {I q J x ) 
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Please replace first paragraph on page 18 of the specification with the following 
amended paragraph: 

A distance function for two image regions based on their texture vectors is expressed as: 
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where a(m^) is the standard deviation of the mean value for a color vector for a region of the 
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i-th frequency channel and i-th orientation channel and where a(G\j) is the deviation of the 
standard deviation of the color vector for a region of i-th frequency channel and the i-th 
orientation channel. 



Please replace paragraph beginning on page 19 of the specification with the 
following amended paragraph: 

FIG. 6 shows an example of taking a texture sample from an image region. In this step, 
the texture sample is obtained using the gray image and a map of a sample region. Referring to 
FIG. 6, a grid map for the sample region is obtained to take a texture sample (Step 602). In 
particular, a rectangle M(iJ) (where, 0 <i <n and 0 <j <m), which has largest side lengths, is 
taken from the sample region. Next, the rectangle M (ij) is divided into sub-rectangles each 
having a / x / size. Then, a grid map for the sample region is made with the following 
predetermined function, which outputs 1 if all the divided grids belong to the sample region, and 
otherwise outputs 0: 



»~W\o o,Her,ise 



where 0 < i < 



m 
7 



- 1 (where 



- 1 (where [n/11 is a result of applying a floor function) , 0 < j < 

rm/11 is a result of applying a ceiling function) , 0<*</- 1, 0<y< /- 1, and p u (x 7 y) is a point 
that belongs to rectangle M(il + jl + y) . 
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Please amend the formulas appearing on page 23 of the specification with the 
following amended formulas: 
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Please replace second full paragraph appearing on page 24 of the specification with 
the following amended paragraph: 

The normalized color and texture vector distances are combined by the following 
function (18) by weighting the color and texture vector distances with weighting factors: 



d{i q ,/,) = wavm 
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AMENDMENTS TO THE CLAIMS 

This listing of claims will replace all prior versions and listings of claims in the 
application: 

LISTING OF CLAIMS: 

1. (currently amended): A method for retrieving a data image similar to a query image 

using a feature distance calculated by combining one or more weighted c olor distances and one 
or more weighted texture distances by considering human visual perception attributes^ 

wherein the one or more weighted color distances and the one or more weighted texture 
distances are obtained by applying predetermined weighting factor to each texture distance and 
to each color distance . 

2. (currently amended): A method for retrieving a data image similar to a query image in 
an image database containing a plurality of data images, the method comprising: 

(a) calculating a plurality of color distances and a plurality of texture distances between a 
query image and each data image in the image database; 

(b) weighting each of the calculated color distances and texture distances with a 
respective predetermined first weighting factor; 

(c) calculating a feature distance between the query image and each data image by 
combining the weighted color distances and the weighted texture distances by applying a second 
set of differing weighing factors that reflect considering human visual perception attributes; and 

(d) determining the data image similar to the query image using the feature distance. 
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3. (original): The method of claim 2, before step (a), further comprising: 

(pa-1) segmenting the query image and each data image into a plurality of first regions 
using a plurality of color features; and 

(pa-2) determining a plurality of sample regions in the query image and each data image 
for extraction of a plurality of texture features. 

4. (original): The method of claim 3, wherein step (a) comprises: 

(al) generating a plurality of color vectors of the first regions using the color features and 
calculating a plurality of color distances; and 

(a2) generating a plurality of texture vectors of the sample regions using the texture 
features and calculating a plurality of texture distances. 

5. (original): The method of claim 3, wherein step (pa-1) comprises quantizing a 
plurality of color vectors of the query image and each data image, 

6. (original): The method of claim 5, wherein quantizing the color vectors comprises: 
(pa- 1-1) performing a peer group filtering on the query image and each data image for 

noise removal and smoothing effects; and 

(pa- 1-2) clustering a plurality of filtered pixel values of the query image and each data 
image using a generalized Lloyd algorithm. 

7. (original): The method of claim 5, further comprising: 



8 



Amendment under 37 C.F.R. §1.111 Attorney Docket No. Q67687 

U.S. Application No. 10/040,621 

defining a J- value indicating a color uniformity in each pixel of a plurality of 
pixels of the query image and each data image, which have undergone quantization; 

storing the J-value in each pixel of the query image and each data image to obtain 
a plurality of J-images; 

segmenting each J-image into a plurality of second regions by a predetermined 
segmentation method; 

repeating the segmentation of each J-image to obtain a map of one or more over- 
segmented regions for each J-image; and 

obtaining a final map for each J-image by merging the over-segmented regions 
based on a correlation of color. 

8. (original): The method of claim 7, further comprising indexing a feature vector space 
by a representative color and a percentage of the representative color in each second region. 

9. (original): The method of claim 6, wherein step (pa- 1-2) comprises applying a 
predetermined algorithm to increase the number of resulting clusters or to merge the resulting 
clusters. 

10. (original): The method of claim 4, wherein the color features are expressed by a 
color feature descriptor f c (I k ) with a representative color vector and a percentage of the 
representative color vector for each first region. 
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11. (currently amended): The method of claim 10, wherein the color feature descriptor 
f c (I k ) is expressed by: 

/c^JM^i.PttMfM.fti) 

wherein k is a positive integer indicating a serial number of each region, c h is an i-th 

representative color vector of a k-th region / = (!, 2 N k ) (i - 1,2,.., AO , p w is a percentage 

of the i-th color representative color vector in the k-th region, and N k is the number of the 
representative color vectors in the k-th region. 

12. (original): The method of claim 8, wherein indexing the feature vector space 
comprises: 

assigning a plurality of representative colors to a plurality of grid points in a color space 
having a grid structure; and 

storing the result of the assignment as a table in a database. 

13. (original): The method of claim 11, wherein the color distance between each color 
vector of each region of the query image and each color vector of each region of each data image 
is calculated using: 

"l *2 *1 *2 

d c {i x j 2 ) = £ pI + £ pi - S E 2a uij PuPij 
i=i i=i /=i j=\ 

wherein when T d is a maximum distance by which a similarity of two colors is 
determined, a is a predetermined scaling coefficient, dmax = &T d > and d tj is the Euclidean 
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distance c ( . - c J between two color vectors c,. and c } , such that a tj = 1- -—— if d i} <T d , and 



max 



14. (original): The method of claim 4, wherein step (a2) uses a Gabor function. 

15. (original): The method of claim 14, wherein, in step (a2), the texture vectors of the 
plurality of sample regions are generated using the Gabor function having N frequency channels 
and M orientation channels, where N and M are both predetermined positive integers. 

16. (original): The method of claim 15, wherein the texture features are expressed by a 
texture feature descriptor /,(/*): 

wherein m m is a mean value of a plurality of pixel values of the i-th frequency channel 
and the j-th orientation channel for a sample region I k , and cr kij is a deviation of the pixel values 
of the i-th frequency channel and the j-th orientation channel for the sample region I k . 

17. (currently amended): The method of claim 16, wherein, in step (a2), the texture 
distance between each color vector of each region of the query image and each color vector of 
each sample region of each data image is calculated using: 
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where o(m\j) is the standard deviation of the mean value for a color vector for a region of the i- 
th frequency channel and i-th orientation channel and where a(Gv) is the deviation of the 
standard deviation of the color vector for a region of i-th frequency channel and the i-th 
orientation channel. 

18. (original): The method of claim 3, wherein step (pa-2) comprises: 

(pb-1) obtaining a grid map of the query image and each data image; and 
(pb-2) obtaining a texture sample of a desired size for each sample region based 
on the grid map. 

19. (currently amended): The method of claim 18, wherein step (pb-1) comprises: 
(pb-1-1) taking a rectangle M(iJ) having largest side lengths for a sample region, 

wherein 0 <i <n and 0 <j <m\ 

(pb-1-2) dividing the rectangle M(iJ) into a plurality of sub-rectangles each having a 
/ x / size; and 

(pb-1-3) obtaining a grid map for the sample region using a predetermined function 
which outputs 1 if all the divided grids belong to the sample region, and otherwise, outputs 0, the 
predetermined function expressed by: 




otherwise 
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wherein 0 < i < 



m 
1 



-1 



- 1 Tn/ll being a result of applying the floor function , 0< j < 

where Im/ll is a result of applying the ceiling function , 0<x<l-l 9 0<y<l- 1, and p u (x 9 y) is 
a point that belongs to rectangle M(il + x, j/ + y) . 

20. (original): The method of claim 19, after step (pb-1-3), further comprising: 

(pb-1-4) transforming the grid map obtained in step (pb-1-3) to a grid distance 
map by repeating computations with: 

{M d grid (iJ)} 0 = M grid dJ),and 

{M d gTid {U])) n = min({M^(/,y- l)}..,, {M d grid (i- lJ)UAM d grid (iJ+ l)} n . P {M^(i+ l,j)}^)+ 1, 

if {M d grid {iJ))n-i = {KAiJ))n>M d grid (iJ) = {M d grid {iJ)) n , and 

(pb-1-5) performing region growing in every direction from a seed of the grid 
map, which has the largest distance in the grid and is expressed by (a,b) = ™ { M grid (iJ)} , 

to satisfy the relation M grid (ij) > 0 until a maximum area rectangle is extracted. 

21. (original): The method of claim 20, further comprising fitting the maximum area 
rectangle extracted in step (pb-1-5) to the desired size of the texture sample by wrapping. 

22. (original): The method of claim 20, further comprising fitting the maximum area 
rectangle extracted in step (pb-1-5) to the desired size of the texture sample by mirroring. 
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23. (original): The method of claim 3, wherein step (b) comprises: 

(b-1) placing each of the color distances and the texture distances in a 2- 
dimensional vector space, each vector space defined by the respective distances and associated 
predetermined weighting factors; and 

(b-2) projecting the result of the placement onto the 2-dimensional vector spaces 
onto a 1 -dimensional distance space based on the human visual perception mechanism. 

24. (original): The method of claim 2, wherein the predetermined weighting factor to the 
color distance is determined based on a distribution of representative colors. 

25. (original): The method of claim 23, wherein the predetermined weighting factor to 
the color distance is determined by: 

®c = 1- X P,i 10 (— ) 

i=l Pqi 

wherein p qi is a percentage of an i-th representative color of one of the first regions of 
the query image. 

26. (currently amended): The method of claim 23, wherein each texture distance is 
defined by: 

A( s) 

<(/ 9 ,/,) = a /l(/ ' ) 
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wherein I q denotes the query image or each first region of the query image, s denotes a 



sample region of a desired size, A(-) denotes the area of the sample region of the desired size, 
count( ) is the number of wrappings done to obtain the sample region of the desired size, and a 
is a constant , and where dt flg ii ) is a distance function for two images based on their texture 
vectors . 

27. (original): The method of claim 23, wherein the predetermined weighting factor 
applied to each texture distance is determined based on an area of an initial sample region 
extracted from the query image and the area of a sample region extracted from each data image. 

28. (original): The method of claim 27, wherein the predetermined weighting factor 
applied to each texture distance is determined by: 

1 



wherein I q denotes the query image or each first region of the query image, s denotes a 
sample region of a desired size, A(-) denotes the area of the sample region of the desired size, 
count( ) is the number of wrappings done to obtain the sample region of the desired size, and a 
is a constant. 

29. (original): The method of claim 23, before step (b-2), further comprising 
normalizing each of the color distances and the texture distances. 




15 



Amendment under 37 C.F.R. §1.111 Attorney Docket No. Q67687 

U.S. Application No. 10/040,621 



30. (original): The method of claim 29, wherein normalizing each of the color distances 
and the texture distances is performed using a Gaussian normalization. 

31. (currently amended): The method of claim 30, wherein normalizing each of the 
color distances and the texture distances comprises: 

wherein v k is a Gaussian sequence, performing a normalization within a range of 

v . - ju k 

[-1, 1] using v mk = — r based on a mean value fi k and a deviation a k of the sequence v k ; 

and 

mapping the result of the normalization into a range of [0, 1] using 
+ 1 



v - — ■ — 



32. (original): The method of claim 31, wherein normalizing each of the color distances 
and the texture distances comprises normalizing the texture distances by updating the mean value 
fi t and the deviation a t of the texture distances by excluding a largest texture distance until the 

M M t 

condition of k x — < — , wherein k is a constant, is satisfied. 

33. (currently amended): The method of claim 23, wherein step (b-2) comprises 
projecting the color distances and the texture distances onto a 1 -dimensional distance space 
using: 
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d{I q ,I l ) = W c d c {I q ,I l ) 



1+— tan 1 



V * d c (I q ,I x )) 



, 2 . 1 ^(/,,/,) > | 
1+_tan "T777 — TT 



where W c = £ — , and W, = J — J 

c ct c + C7, m e + ar. 



W, 



wherein W. = We + W< . and W, = Wc + W( and where d VCI j, I L ) and where d'/l). Ii) 
represent normanz,eu uisiance functions for two image regions based on their color and texture 



vectors, respectively. 



34. (new): The method according to claim 1, wherein the predetermined weighting 
factor applied to said each texture distance is determined based on an area of an initial sample 
region extracted from the query image and an area of a sample region extracted from each data 
image. 



35. (new): The method according to claim 34, wherein said combining of the one or 
more weighted color distances and the one or more weighted texture distances comprises 
weighing the one or more weighted color distances and the one or more weighted texture 
distances with differing weighing factors, said variation of the weighting factors reflect the 
human visual perception attributes. 
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